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What is claimed is: 

\ 1 . A video encoding apparatus comprising: 

dti orthogonal transform circuit for orthogonally 
transforming an input picture signal to obtain a 
plural it A of transform coefficients; 

a firVt local decoder for outputting first 
transform coefficients for a fine motion compensation 
prediction piVture on the basis of a previous picture; 

a second local decoder for outputting second 
transform coef f j^cieriXs for a coarse motion compensation 
prediction picture on the basis of a current picture 
corresponding uo tVe input picture signal; 

means fori detecting a degree of motion 
compensation prediction? in said second local decoder; 

a selector Vor ^iecti/vely outputting the first 
and second transform coefficients in accordance with 
the degree of motion compensation prediction; 

a first calculator for calculating a difference 
between the transform coefficients of said orthogonal 
transform circuit and ones ©f the first and second 
transform coefficients which\are selected by said 
selector, and outputting a mousion compensation 
prediction error signal; \ 

a first quantizer for quantizing the motion 
compensation prediction error signal from said first 
adder and outputting a first quantised motion 
compensation. prediction error signal\ 
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a second calculator for calculating a difference 
between the second transform coefficients from said 
second Vocal decoder and the transform coefficients 
from theXorthogonal transform circuit, and outputting 
a second niption compensation prediction error signal; 

a secorid quantizer for quantizing the motion 
compensation prediction error signal from said second 
calculator, anck outputting a second quantized motion 
compensation prediction error signal; and 

an encoder fo\r encoding the first and second 
quantized motion compensation prediction error signals 
and outputting enc^^d^s^gnals . 

2. An apparatus ^accoixding to claim 1, wherein 
said orthogonal t^ansfoVn .circuit divides the input 
picture signal intoV- piyi^ality of blocks each having 
a size of N x N pixels, ortfi^gonal ly transforms the 
picture signal in units of \blocks each having the size 

of N x N pixels, and outputs^ N x N transform 

*\ 

coefficients to said first ang second adders in units 
of blocks . 

3. An apparatus according^o claim 1, wherein 
said means for detecting degree oA motion compensation 
prediction compares the second transform coefficient 
from said second local decoder with\t\he transform 
coefficient from said orthogonal transform circuit and 
outputs a detection signcl corresponding to the degree 
of motion compensation prediction, and sAid selector 
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selbcts the first transform coefficient from said first 
local decoder in response to a detection signal 
representing that motion compensation prediction is 
correct^ and selects the second transform coefficient 
from said second local decoder in response to a 
detection ^ignal representing that motion compensation 
prediction iSs incorrect. 

4. An apparatus according to claim 1, which 

\ 

comprises a motion vector detector for detecting a 
motion vector from the input picture signal, said first 



local decoder 
dequantizing t 
prediction erro 




a first dequantizer for 

ntized motion compensation 
roVi said first quantizer and 



outputting a first o-u4ptft signal, a first aader for 
adding the first output v s ig^ial from the first 
dequantizer and the transform coefficient selected by 
said selector and outputting a first local decoded 
signal, and a first motion^compensation prediction 
circuit for obtaining the fixst transform coefficient 
on the basis of the first locaU decoded signal from 
said first adder and the mot ion\ vector , and said second 
local decoder comprises a second Xdequantizer for 



dequantizing the second quantized motion compensation 
prediction error signal from said second quantizer, and 

:ond output signal, a\second adder for 
adding the second output signal from s^aid second 
dequantizer and the second transform coefficient and 



outputting a secc 
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outputting a second local decoded signal, and a second 
motion compensation prediction circuit for obtaining 
the second transform coefficient on the basis of the 
second Vocal decoded signal from said second adder and 
the motion vector. 

5. AV video encoding apparatus comprising: 
an ortKogonal transform circuit for dividing an 
input video sVgnal into a plurality of blocks each 
containing N x\n pixels and orthogonally transforming 
the input video\signal in units of blocks to obtain a 
plurality of tranfejEusLxn^ coefficients divided in spacial 
frequency bands/ 

a first mc\tion\predi^ction processing section for 
performing motichj compensation prediction processing 
for the plurality of tVarfsform coefficients in order to 
obtain an upper-layer motion compensation prediction 
signal having the number\of data enough to obtain 
a high image quality; 

a second motion prediction processing section for 
performing motion compensation prediction processing 
for the plurality of transfori^ coefficients in order to 
obtain a lower-layer motion compensation prediction 
signal upon reducing the number\of data; 

a decision section for deciding in motion 
compensation on the basis of the lower-layer motion 
compensation prediction signal whether motion 
compensation prediction is correct; 
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a\selector for selecting the upper-layer motion 
compensation prediction signal in response to a 
decision representing a correct motion compensation 
prediction^ f rom said decision section, and the lower- 
layer motioA compensation prediction signal in response 
to a decision^ representing an incorrect motion 
compensation prediction; and 

an encoderXfor encoding one of the upper-layer 
motion compensation prediction signal and the lower- 
layer motion compensation prediction signal which is 
selected by said s^c&qx. 

6. A video /enc©ding\apparatus for realizing SNR 
scalability in Mylayen/s, comprising: 

an orthogonal transform circuit for dividing 
an input video signal into a plurality of blocks each 
containing N x N pixels and orthogonally transforming 
the input video signal in units of blocks to obtain a 
plurality of transform coefficients divided in spacial 
frequency bands; \ 

a first motion compensation prediction processing 
section for performing motion compensation prediction 
processing for the plurality of transform coefficients 
in order to obtain an mth-layer (A = 2 to M) motion 
compensation prediction signal; \ 

a second motion compensation prediction processing 
section for performing motion compensation prediction 
processing for the plurality of transform coefficients 
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in\order to obtain an (m-1 ) th-layer motion compensation 
prediction signal; 

switching means for selecting the mth-layer motion 
compensation prediction signal of said first motion 
compensation prediction processing section in order to 
obtain ammth-layer prediction value when a quantized 
output from said second motion compensation prediction 
processing section is 0, and switching between the mth- 
layer motionXcompensation prediction signal and the (m- 
1) th-layer monion compensation prediction signal in 
units of transform coefficients in order to select the 
( m- 1 ) th-layer moVi^JrT^ompensation prediction signal 
when the quantised output is not less than 1; 

means for/ caltuLeting a difference signal between 
an (m- 1 ) th-laye^^^qi\an^ized output from said second 
motion compensation prediction processing section and 
an mth-layer motion compensation predic tion error 
signal obtained by a difference between the mth-layer 
motion compensation prediction signal and the transform 
coefficient from said orthogonal transform circuit; and 

encoding means for quantizing and encoding the 
difference signal to outpun an encoded bit stream. 

7. An apparatus according to claim 6, wherein 
said switching means comprise'^ means for switching 
an mth-layer (m = 2 to M) quantization matrix between 
a transform coefficient corresponding co a quantized 
output of zero in the (m-l)th latter ani a transform 
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coefficient corresponding to a quantized output of not 
less \han 1. 

8\ An apparatus according to claim 6, further 
comprising means for, when quantized values of two- 
dimensional orthogonal transform coefficients in the 
mth layer Vm = 2 to M) are to be arranged into a one- 
dimensionalVseries , arranging a transform coefficient 
corresponding^ to a quantized output of not less than 1 
in the (m-l)t\ layer and then a transform coefficient 



antized output of 0 in the (m-l)th 
namep . 



corresponding 
layer in an ord 

9. An apparatus Recording to claim 6, wherein 
said orthogonal tra 
transforming an 

transform coefficient \in accordance with an alpha-map 
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orm circuit comprises means for 
ry-shape picture into a 



\ 



signal for discriminating a background of an input 
picture from an object\t^ereof , said encoding means 
comprises means for enco^d\ng the alpha-map signal, said 
first motion compensation; prediction processing section 
comprises means for inversely transforming the 
transform coefficient in actcirdance with the encoded 
alpha-map signal to reconstruct the arbitrary-shape 



picture 
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A video encoding/decoding system comprising: 

\ k 

a video encoding apparatus \f or realizing SNR 

\ \ 

(Signal to Noise Ratio) scalability in M layers, which 
includes , 
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n orthogonal transform circuit for dividing 
an input vi\deo signal into a plurality of blocks each 
containing N x N pixels and orthogonally transforming 
the input violeo signal in units of blocks to obtain a 
plurality of transform coefficients divided in spacial 
frequency bands, 

a first motion compensation prediction 
processing section for performing motion compensation 
[ ! j prediction processing for the plurality of transform 

10 coefficients in oider to obtain an mth-layer (m = 2 to 

M) motion compensation prediction signal, 

a second {notion compensation prediction 
processing section for performing motion compensation 
ly prediction prooressinA for? the plurality of transform 

Iff 15 coefficients in crfuler^^o\Q^btain an ( m- 1 ) th-layer motion 

j:£ compensation prediction signal, 

switching meals for selecting the mth-layer 
motion compensation prediction signal of said first 
motion compensation prediction processing section in 
20 order to obtain an mth-layer prediction value when a 

quantized output from said ^second motion compensation 
prediction processing section is 0, and switching 
between the mth-layer mot ion ^compensation prediction 
signal and the (m-1 ) th-layer motion compensation 
25 prediction signal in units of transform coefficients in 



order to select the (m- 1 ) th-layer motion compensation 
prediction signal when the quantized output is not less 
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than ly 

means for calculating a difference signal 
between ^n (m-1 ) th-layer dequantized output from said 
second motion compensation prediction processing 
section ano\ an mth-layer motion compensation prediction 
error signal\obtained by a difference between the mth- 
layer motion compensation prediction signal and the 



transform coefficient from said orthogonal transform 
circuit, and 

encoding^means for quantizing and encoding 
the difference si^g^ad. toN^utput an encoded bit stream; 
and 

a video decbdinq Apparatus which includes, 



means for extracting codes up to a code in 



the mth (m = 2 to M) layei^from the encoded bit stream 
from said video encoding d\ 



jaratus 



decoding means for\ decoding the codes of 

\\ 

respective layers up to the nAh layer, 

dequant izat ion meansAfor dequant izing , in the 
respective layers, the quant izeg\ values decoded by said 
decoding means , 

switching means for swifc^iing the mth-layer 

\ 

(m = 2 to M) motion compensation prediction value and 

\ \ 
\ \ 

the (m-1) th-layer motion compensat Lon \predic tion value 

\ , 

in units of transform coefficients, ahd\ outputting the 
mth-layer motion compensation predictio^n\value for the 
quantized output of 0 in the (m-l)ch layerv and the 
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the quantized output of not less than 1 in the (m-l)th 
layer am units of transform coefficients in order to 
obtain tShe mth-layer prediction value, and 

\means for adding the mth-layer motion 
compensation prediction value and the (m-1 ) th-layer 
motion compensation prediction value to reconstruct the 
mth-layer motion compensation prediction error signal. 

11. A sysVem according to claim 10 , further 
comprising switching means for switching an mth-layer 
(m = 2 to M) quantization matrix between a transform 



coefficient correspefi4ing to a quantized output of zfjro 
in the (m-l)th ]/ayer and\ a transform coefficient 
corresponding to\ a quantised output of not less than 1. 

12. A system acMtding to claim 10 f wherein said 
decoding means compriaesV means for decoding an alpha- 
map signal for discriminating a background of an input 
picture from an object uhereof, and means for inversely 
transforming the arbitrary _sha P e picture transformed 
into the transform coefficient in accordance with the 
encoded alpha-map signal to\ reconstruct the arbitrary- 
shape picture. 

13. A video encoding apparatus comprising: 
an orthogonal transform circuit for dividing an 

input video signal into a plurality of blocks each 
containing N x N pixels and orthogonally transforming 
an arbitrary-shape picture in unites of blocks in 
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accordance with an alpha-map signal for discriminating 
a background of an input picture from at least one 
object\ thereof to obtain a plurality of transform 
coefficients ; 

5 a f j\rst motion compensation prediction processing 

section having frame memories respectively 
corresponding to the background and at least one 
object f means\ for inversely transforming the transform 
coefficient in* accordance with the alpha-map signal to 
10 reconstruct the arbitrary-shape picture, and means for 

performing motion\ compensation prediction processing 

A 

for the plurality/ of transform coef f icients , said first 
motion compensation prediction processing section being 
adapted to obtain an"trpp^r-/layer motion compensation 

15 prediction signal having\the number of data enough to 

\ \ 

obtain a high image quality; 

a second motion compensation prediction processing 
section having frame memories respectively 
corresponding to the background and at least one 
20 object, means for inversely transforming the transform 

coefficient in accordance witA^ the alpha-map signal to 
reconstruct the arbitrary-shape^ picture , and means for 
performing motion compensation prediction processing 
for the plurality of transform coefficients, said 

\ 

25 second motion compensation prediction processing 

section being adapted to obtain an lower-layer motion 
compensation prediction signal upon reducing the number 
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of c^ata; 

decision section for deciding in motion 
compensation on the basis of the lower motion 
compensation prediction signal whether motion 
5 compensation is correct; 

a selector for selecting the upper-layer motion 
compensation^ prediction signal in response to a correct 
motion compensation prediction from said decision 
section, and tke lower-layer motion compensation 
10 prediction signal in response to an incorrect motion 

compensation prediction; and 

an encoder for encoding a motion compensation 
prediction value! selected by said selector. 

14. An appar^i^as^cordi.jig to claim 13 , which 

15 includes means for detecting a motion vector for each 

object and the background in a block containing a 

\ 

plurality of objects or the background, and a motion 

vector detection range in\the block containing the 

\ 

plurality of objects or the^ background is narrower 
20 than that in a block containing one object or the 

\ 

background. ^ 

15. An apparatus according to claim 13 , further 
comprising motion vector, detection means for detecting 
a motion vector in units of o^j^cts and performing 

25 motion vector search operation in\ the same object. 

16. A video encoding apparatus comprising: 
an orthogonal transform rircuiV for dividing 
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an\input video signal into a plurality of blocks each 
containing N x N pixels and orthogonally transforming 
an arbitrary-shape picture in units of blocks to obtain 
a plurality of transform coefficients; 

means for encoding and outputting an alpha-map 
signal for discriminating a background of a picture 
from an object thereof; 

means fqr calculating an average value of pixel 
values of an abject portion using the alpha-map signal 

in units of blocks; 

\\ 

means for assigning the average value to a 

\\ 

background port ioii of the block; 

means for c^eciViing \sing the alpha-map signal 
whether a pixel \Ln the object is close to the 
background ; 

means for compressing, about the average value, 
the pixel in the object \lecided to be close to the 
background; and 

means for orthogonallV transforming each block to 
output an orthogonal transform coefficient. 

17. A video encoding/decoding system comprising: 
a video encoding which includes , 

an orthogonal transfoinrn circuit for dividing 
an input video signal into a plurality of blocks each 



A 



consisting of N x N pixels and orthogonally 



transforming an arbitrary-shape picsture in units of 
blocks to obtain a plurality of transform coefficients, 
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meansV for encoding and outputting an alpha-map signal 
for discriminating a background of a picture from an 
object t\hereof, 

means for calculating an average value of 

\\ 

pixel valixes of an object portion using the alpha-map 
signal in uYiats of blocks, 

v 

means for assigning the average value to a 

background portion of the block, 

\ \ 

means^for deciding using the alpha-map signal 



whether a pixel 
background , 



rtre object is close to the 



A 




means foV compressing, about the average 



in> 



value, the pixel 
the background, and 



object decided to be close to 



means for orthogonally transforming each 
\ 

block to output an orthogonal transform coefficient; 
and 

a video decoding apparatus which includes, 

means for decoding the alpha-map signal 
encoded by said video encoding apparatus, 

means for decoding a\ block from the 

\\ 

orthogonal transform coefficient, 

means for calculating lan average value of the 
obje:t portion, the background portion, or the entire 
blocx, 

means for deciding using the alpha-map signal 
whetner the pixel in the object is cl^ose to the 
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background, and 

means for decompressing, about the average 
valiae, the pixel in the object decided to be close to 
the background by said deciding means. 

18^. A video encoding apparatus comprising: 
an\ orthogonal transform circuit for dividing an 
input video signal into a plurality of blocks each 
containing -N x N pixels and orthogonally transforming 
an arbitrarWslT^pe picture in units of blocks to obtain 
a pluralitjy of transform coefficients; 

means foA\encoding and outputting an alpha-map 
signal for discY'iftvinat irg a background of a picture 

from an object thereof; 

\\ 

means for calculating an average value of an 

\ \ 

object portion in uVits of blocks for the picture, 
using the alpha-map signal; 

means assigning tl^e average value obtained by said 
means for calculating the average value to a background 
portion of the block; 

means for deciding usVng the alpha-map signal 



whether a pixel in the background is close to the 
object ; 

means for correcting theVpixel in the background 
which is decided to be close tq\ the object as a 
decision result of said deciding\ means in such a manner 
that a pixel value of the pixel opmes close to a pixel 
value of the object near the pixels and 



for outputting an orthogonal transform 
coefficient obtained by orthogonally transforming the 
block . 



